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ABSTRACT 

This paper concerns two features of a project on the 
assessment of job potential; the J-Coeff icient , and the J-Scale. The 
J— Coef f ic lent is a means of determining the validity of a test for a 
position on the basis of (1) the Beta weights for predicting test 
scores from a set of elements and (2) estimates of importance of each 
element in the particular job. The other feature, the j-Scale, is a 
method in which elements of ability, knowledge, skill or personal 
characteristics are selected for a particular job, on the basis of 
their amenability to valid rating when examiners evaluate experience, 
training, education, etc,, as well as tests. See also TM 001 164-166 

for further information on the Job Element (J-Scale) method. 
(Author/DIG) 
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Substance of Presentation on 

The J-Coof ficient and Job-Element 
Procedure as a Means of Intecr-jiting 
All Evidences of Ability to Meet 
Educational or Job Requ ■i.roi.ionts 

. APGA Convention - Apri.l 8^ 1963 

Ernest S, Primoff 

Personnel Measurement Research and Development Center 
United States Civil Service Coimnission 
Washington, D, C, 



My early work with the. J-Coefficient and Job-Element procedure is described 
in the enclosed paper by Dr, Maslow, "Suminary of Paper on Job Analysis 
Techniques Presented at the Personnel Selection Institute, Public Personnel 
Association, Chicago, Illinois, October 1958." You will find additional 
information in Lawshe and Balma, Principles of Personnel Testing (second ed.) 
McOraw Hill, 1966, pages 255-257* 271, 292-293, and in additional references 
given there. 
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One feature of the Job-Element procedure is the J-Coefflcient. This co- 
efficient, as explained in the above citations, is a means of determining 
the validity of a test for a position on the basis of (1) the Beta wej-ghtrs 
for predicting test scores from m sat of elements and (2) estimates of 
importance of each element in the particular job, 

/ ■ 

Another feature in the Job-Element procedure is the J-Scalef, in which elements 
of abilityj knowledge, skill or personal characteristics are selected for a 
particular job, on the basis of their amenability to valid rating when exam- 
iners evaluate experience, training, eduoatioiii, etc*, as well as teats. 

An early application of the J-Soale method is shown in ”Applioatian of Job 
Element J-Scale Method to Job Analysis and Selection of Inspectors^’ ^ oopy 
of which is enclosed. (The present J-Scala formula represents an improvement 
over the one shown in this paper.) The rating scale for Element 2, Ability 
to Learn to Make Acceptable Inspection Reports, on page 8 of bhia enclosure, 
shows how test and other evidences are used to evaluate an element. 










U S, DIP^jRTMENT UP HEAtTH. 

EDUCATION & WfLFARE 

OFFICE OF Education 
IS DOCUMINT HAS BllN REf-RO' 
JCED fKACTLY Ai RECilVED FROM 
6 PiRSON OR QRQANIZATION ORIG- 
ATING IT. POINTS OF VIEW OR QPIN* 
NS STATID 00 NOT NiCESSARlLY 
iPRESENT OFFICIAL OFFICE OF iOU- 
ltihm pn^lTiQN DR POLICY, 



2 



The purpose of my presentaticn s.t the A?GA Convention v/as to sncw some oj. 
the latest work I have been doing in the Job“-*i^letr.ent procedure 'which is 
especialD^y appropriate w’hen dealing with deprived groups, Aluhougn ny j.xrst 
studi.es in this vrork had been wii-h jobs, for this praservoaticn I used high 
school data in order to show the application Tor scholasgic counsej_ijig. 

In the J-'Coef ficient procedure. Beta weights are daterrAined lor each oi a 
set of eleinents to predict a test score# The nurn of products oi taese 
weights tinies correlations of elements with joo (by derinitlon proper i^lonal 
to importance of element in job) is oQual to the validity coeiiicient whan 
there are enough elements to completely determine test (that is, when multipLe 
R of test score on elernents is unity)# 

In. the J-Scale procedure^ when only a small nuifiber of eleiAonts are used, 
there are not enough elemGnts to completely determine a test score# In this 
case. Betas may be divided by R, assuming that the part of the variance tricot 
is in a test, but not in the elements, is similar to the part of the variance 
that is in the elements. 

Table 1 in the handout shows the test weights (Bata/^) for each of five 
elements to predict certain tests* For example, the Paper Foriu ooard is 
made up of about .2$ X Knowledge of mechanic's tools and machinas, ,20 x Interest 
in reading written material, .06 x Understanding meehanical devices, #2U x 
Education, and ,66 x Trades Interest, In examining practice, several evidences 
are used to measure each elementj however, for the purpose of this presentation, 
only one evidence was used for each element, as shovm in Table 1, 

This type of analysis is more meaningful then the usual factor analysis because 
it is in terms of real elemsnts that are defined in advance in terns of the 
specific evidences that are most appropriate for the domain, and can actually 
be measured for each subject. In orthogonal factor analysis, the factors are 
not defined in advance of the study, and the scores of each subject on each 
factor can be estimated only roughly. The basic difference betw^een elements 
in the Job«Element procedure and factors in orthogonal factor analysis Is that 
the eleirents are expected to be related (i.e., not independent). This is 
an advantage, since real abilities tend to have fairly high in correlations* 
Because elements are not independent. Beta weights have to oe used instead of 
aimole correlations . Inter correlations are sums of products of Beta weights 
times correlations, rather than correlations times correlations as in orthog^ 
onal factor analysis. 

Since J-Coefflcients are sums of products of Betas and r*s, the geometric 
form for an element involves two ^es, with Betas to predict tests bn one 
axis and correlations with testa on the other axis. Chart 1 shows the geometric 
form for one element--Knowledge of mechanic -s tools and machines, (The J-Co-- 
efficient formula is the generalized formula for elements or factors, regard^ 
less of whether the elements are independent or not. In orthogonal factor 
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ar.«.Xysis, r's and Botas are eQuaX because rncuors have; zero lntercorrelaT,j.ons, 
and so there is no distinctiori between r's and Betas . ) 

J-Coef fi cieTits can be calculated betweeri two tests by surruTiing . ne products 
of >eta times r on the elements. These J-Coefficionts represent that part 
of the test intercorrelations that is related to the elements . (Actually 
thspt- arc two J-Goef ficients, on-? for Beta oi Tci-" a tiines r Ox lest B, 
and one for Beta of Test B times r of Test A. A sin.^le coof f ici. it can t.nen 
be achieved by taking the geometric mean of the two.) 

Table 2 shows the J-Coef ficient (corriputed from the Beta weights shown in^ 

Table 1 and the correlations of the tests with the elements j.nu correldt^on 
betv;een J-Coof ■';' i*"nts and actual intercorrelations of the tests is .991,.* 

The greatest discrepancy is for intercorrelation of Stenquist 1 ano Stenquist 
2, because these tests include a common factor that is not in the elements 
and therefore would not affect the J-Coef ficient. The common factor probably 
hr.r, to do with the fact th ' t the same author produced both tc-mts x-or a. very 
similar purpose, so that ti.ese two tests have in common some very specific 
test variance. 

Since the element weights are Betas, and since pupils have been given actual 
ratings in each element, "synthetic" test scores can be obtriiiied by applying 
the Fieta/R weight to standardized element ratings. Table 3 shows the s^itnetie, 
test scores and the actual test scores on the Otis, The formula for thi,s 
synthetic test score is given in Table U. ?or some pupils, the s^withetic 
test score and the actual Otis score are quite close j for example, the synthetic 
SCOTS for pupil No. 1 is 33> and the actual score is 32, (See note on page ii-) 

On the other hand, for some pupils the s^mthetiG score is higher^ For example, 
pupil No. 19 g©ts a synthetic score of UO, and an actual score oi 29* Since 
the synthetic score is based on abilities, it is likely to be more representa- 
tive of academic g ’ade than the Otis score If the pupil has difficulty taking 
tests. In the case of this particular pupil, where the synthetic score was 
ho, while the actual Otis score w.aa only 29, the academic high school grada 
was h*0, very high. There were a number of pupils., on the o:.aer hand, like 
pupil No. 21, who have higher Otis scores than synthetic scores . These pupils 
Were usually a year or. more younger than the class and probably had not had 
^ opportunity to demonstrate ability, on ale manta such as in Table 1, but were 
able to demonstrate potential in the actual Otis test. Thus, pupil No. 21 
who got on the actual Otis and only 28 on the synthetic test, also got 
U *0 in academic grade. . 

In civil service practice, it would probably be necessary to count the higher 
of the two scores--the sjnithetic score or the actual score. For counseling 
purposes information available to the counselor could be used to indicate to 
him which soora is more meaningful in an individual case, 

'^hen all intercorrelations are included: r ^2 ^3 ••••• ^nd T2X ^"31 ate. 

In the tables, r^s that would be lander the diagonal of a niatrix are not 
given. 
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A final aspect mentioned in the presoiitation was the use of a J-Coor:‘Icier.t. 
analvsis in deterniinin^: eleir.ents present in a test, but noT^ in a job aituabion. 
Often, such an element may discriminate against certain racial or soclai 
groups, and it is useful to ba able to put the statistical niicroscope over 
a test to eliminate certain unnecessary elements* One example citod was an 
arithmetic test where the test included content obviously requiring memory, 
but where memory as measured in the test had no Beta weight on ncHr.ory i’cquired 
by jobs. By decreasing the content of memory from the arithmetic test, a 
teat was devaloped which can '^pass*^ applicants from deprived groups w'ho can 
take an apprentice training course but who eoula not pass the original 
arithmetic test. 

It is enphasized that the data used for the presentation w^ere selr-cted 
because they were available to illustrate a procedure* In practice, it would 
be necessary to use the most appropriate elerriCnts for any particular situation 

Note ; Before calculating synthetic scores, elenients vrith negati ve weights 
for an ability test are eliminated for that test, and Beta weights 
are recomputed, since logically abilities should ba addibive positively 
in any test* Thus, Element 1 was eliminatad before synthetic scores 
were computed for the Otis test# 
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Table 1. 

Toat i‘/elghts (Betn/H) 

(Based on dat« for Jordan Junior 
High School pupils reported in 
P&tarBQii, Da Gvj Elliott, Ro M . ^ 
Anders cn .5 D.;, Toops.- H, A„i, and 
Heidbredoi", Edim,. (19 Ki) Minnaapolis 
meehaj;lcal ability tesc-s,, Univ, of 
Hiimc Pre?js.) 
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Elaraant 1 - Knowledge of mechanic '^s tools and Machines 
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J^Coef ficients Compared With Actual Test Intercorrelationa 
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Synthetic Otis Raw Score Compared to Actual Score 
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Formula, for S|Tithetlc Score, Otis 
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Correction for Mean, * Hoan Otis -‘^Wt Mean - - 15.1052 



